Networks and Our Limited Information Horizon 
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In this paper we quantify our limited information horizon, by measuring the information necessary to locate 
specific nodes in a network. To investigate different ways to overcome this horizon, and the interplay between 
communication and topology in social networks, we let agents communicate in a model society. Thereby they 
build a perception of the network that they can use to create strategic links to improve their standing in the 
network. We observe a naiTow distribution of links when the communication is low and a network with a broad 
distribution of links when the communication is high. 
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I. INTRODUCTION 

Communication is a fundamental element in maintaining 
the overall cooperation between different parts of a complex 
system. Because a complex system consists of many different 
parts, it matters where signals are transmitted. Thus signal- 
ing and traffic is in principle specific, with each message go- 
ing from an unique sender to a specific target. Networks are 
therefore a powerful way to represent this constrained com- 
munication of the real world fRos vall & SneDPenll2003ll . 

We start by using walks in networks with specific targets to 
quantify the information necessary to locate specific nodes in 
the network f Sneppen et a/.", "20051, and also to investigate the 
constraints limited information sets on the navigability. The 
process consists of extracting information at the nodes on the 
walk between a source and a target. The subsequent ques- 
tion is therefore the availability of this information. We there- 
fore let agents in a model society use local communication 
to self-organize distant communication-pathways. In this way 
we demonstrate that simple local rules allow agents to build a 
perception of a dynamic system. This perception guides a tar- 
geted signal ac ross the network bey o nd the information hori- 
zon J Friedkin, 119831 iTrusina et ali l2005l IValverde & Soli 
|2004'| . Further we in this minimalistic model find that mes- 
sages are most effectively forwarded in th e presence of hubs 
with funneling Ijeffrev & Milgrani Il969ll . like in scale-free 
networks, while transmission in hub-free networks is more ro- 
bust against misinformation and failures. 

With the locally generated global information of the net- 
work, we can take the model society one step further and let 
the agents use the information to create strategic links. In this 
way we are able to model the self-organization between com- 
munication and topology in social networks, with a feedback 
between different communication habits and the topology. We 
observe a narrow distribution of links when the communica- 
tion is low and a system with a broad distribution of links 



when the communication is high. 



II. NAVIGATION IN NETWORKS 



The simplest walker is the random walker, which has 
been used to characterize topological features of networks 
I Bilke & Peterson, 2001, Monasson, 1999|, including first 
passage times |Noh & Rieger, 2004], large scale modular fea- 
tures |Eriksenefc[|j||2003], and search using topological fea- 
tures I Ada mic ef a/.L l2()01]. Here we instead take the opposite 
approach and consider a direct walker In particular we quan- 
tify the informat ion necessary to locate specific nodes in the 
network | Snepp en et a/.ll2005ll . and investigate the constraints 
limited information sets on the navigabihty iRosvall et all 
2005aJ. 

A walk consists of stepping from node to node via the links 
between them. The walk from a source node 5 to a target 
node t may be more or less directed depending on the walkers 
ability to choose exit links that lead it closer to the target (see 
Fig.njc-d)). We first quantify the information cost in number 
of bits I{s -^t) ~ L;epath(.it) ';■' i'- takes to navigate the shortest 
path from node s to node t, as the sum of the local information 
ijt on every node j on a walk "path(j'f)" leading to target t. 
That is, ijt is the number of bits one needs on node j to select 
one exit that leads to t. If no degenerate paths exist, as in 
Fig.^a), then ip = \0g2kj, where kj is the degree (number of 
links) of node j, since the task is to select one link among kj. 

When there are two or more degenerate paths from /' to t, 
the required information depends on the relative probabilities 
that one wants to choose each shortest path with, and ijt above 
generalizes to 



^I0g2(^j)+^?;7(l0g2?i/r, 



(1) 
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where q^t is the probability to choose a link to node / from 
node /■ on a walk to node t (Y,i'ijit = !)■ Qjit = if the link 
is not on the shortest path between j and t. We will choose 
the probability to leave a node along a link on a shortest path 
between s and t to minimize the total information cost I{s -^ 
t). Thus, if there are many degenerate paths, the probability 
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FIG. 1 Navigation in networks, (a) It is possible to ask yes-no ques- 
tions and successively eliminate groups of wrong exits if the links 
are ordered. Every yes-no question optimally reduces the number 
of possible links with 1/2 and the cost is log2^ to find the correct 
exit link, (b) The outcome of the elimination process is uncertain if 
the information that can be received is limited, and there is a finite 
probability to make mistakes (qjj, in the direction / at this node j on 
the way to target node t). The color of the nodes and links in the 
lower panel represent the average number of questions necessary to 
navigate to the node, (c) With in total 13 bits it is possible to find 
the shortest path between the marked source and target, (d) With the 
information limited to 1 bit/node the navigation becomes here 3 steps 
longer (total cost is 8 bits). 



to exit to node e from node j on the shortest path to t is 



-^^^^, where pp, = ^ 



/Gpath(;!Y) ' 



(2) 



is the probability to walk the shortest path to t from node j via 
the link to node / in an unbiased walk. 

We now turn to the limited information perspective, and 
assume that the amount of information at a node is limited to 
; bits (see Fig.[nb) and Java applet |URL, a]). The walk can 
now be substantially longer than the actual shortest path. In 
Fig- Ed) ' = 1 and the walk is about 3 steps longer than in 
Fig.^c) with unlimited information. To limit ij, to ; we blur 
the ^-values of node j in Eq. (|2j by a e,-, G [0,°°], through 



Ijit ^ Ijiti^jl) 



~ l+kfy 



with Sjt determined by 



Ij, = log2(fc;) + ^^;,-,log2^^;, < I. 



(3) 
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The navigability of a network is determined by its topol- 
ogy, hence it depends on both the degree distribution and how 
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FIG. 2 Information horizon in three real-world networks. We com- 
pare information associated to navigation between nodes at distance 
/, with the navigation in randomized counterparts (keeping the degree 
sequence) for ; = <», 2 and 1. The Internet (hardwired Internet of au- 
tonomous systems | URL, b]) is more sensitive to limited information 
than the similarly sized CEO (Chief Executive Officers connected by 
links if they sit at the same board liDavi s & Greve, 1997]). The city 
network is the Swedish city M almo with streets mapped to nodes and 
intersections mapped to links iRosvall et a/.i.i2005bi1 . 



nodes of various degrees are connected to each other Here 
we focus on comparing a given real-world network with its 
randomized counterparts, created by rewiring links such that 
all nodes conserve their deg ree, and such that the net work 
remains globally connected itMaslov & SneppenL l2002ll . In 
Fig.|2]we resolve /, into /,(/) and examine the average infor- 
mation associated to walking to a specific node a distance I 
away in the real and in the randomized (/™'^°™(Z)) network 
llTrusinaefadl2005ll . 

The pattern that the real networks demand less information 
than their randomized counterparts on short distance, / < 3, 
suggests that many real-world networks favor communication 
on short distance at the cost of constraining communication 
beyond this horizon. Furthermore, this feature is more evident 
with limited than with complete information. 

All results until now are based on the assumption that in- 
formation is available at every node, although the information 
can be limited. To address the question of how this informa- 
tion can be assembled, we in the next section turn to a social 
game and let agents in a model society use local communica- 
tion to build a global perception of the network. 



III. SELF-ASSEMBLY OF INFORMATION IN NETWORKS 

To visualize our basic approach we illustrate in Fig.|3]a net- 
work composed of individual agents, each of them connected 
to one or more acquaintances. Each individual communicates 
with its immediate neighbors to exchange information about 







FIG. 3 Modeling self-assembly of information in networks. Agents 
at nodes, connected by links, communicate with their connected ac- 
quaintances about any third target agent in the network, and estimate 
the quality of the information by its age (clocks over heads corre- 
spond to, from left to right, the age of the information about agent 1, 
2,. . . 7). The pointers are, for every agent, the acquaintance that con- 
nects most efficiently to each of the other agents in the system (here 
only indicated for agent 1, 2, 5, and 6, dashed pointers are outdated). 



agents in other parts of the system. In this way every individ- 
ual gradually builds up a global perception by knowing people 
through people IFriedkin, 198 21. In our minimalistic model, 
we allow each agent to have the information about which of 
its neighbors that connects most efficiently to each of the other 
agents in the system. Thus, a perfectly informed agent knows 
in which direction to send a message to any other agent in 
the system. If all agents were perfectly informed, any mes- 
sage would be reliably forwarded from sender to recipient, 
using the in formation of the subsequent agents along its paths 
llJeffrev & Mikram.. 1969.1 . 

The key question is how different communication rules of 
the agents influence their possibility to obtain a reliable per- 
ception that is robust to dynamical changes of the network. 
Obviously, the agents need some index of quality that let them 
judge whom of their acquaintaces that has the best knowledge 
of a particular agent. We have found that the age of the in- 
formati on about an agent gives a v ery good estimate of the 
quality llRosvall & Sneppenll2006tl . That is, the perception 
consists of, for every agent about any other agent: 

• The age of the information about the other agent 
(clocks in Fig.|3}- 

• From whom the information came 
(pointers in Fig.|3}- 

This defines the model together with the communication 
event: 



• Select a random link and let the two agents that it con- 
nects communicate about a random third agent. The 
two agents also update their information about each 
oflier. 

For example, when an acquaintance of agent 5 in Fig. |3] ob- 
tains information about 5, it sets its pointer to 5, and the infor- 
mation starts aging. With successive communication events, 
the information spreads from agent to agent and gets older and 
older (we increase the age of all information when all links 
on average have participated in one communication event). 
When two agents compare the validity of their pointers to a 
target agent, like 1 and 6 to 5 in Fig. |3] they validate the 
newest information as the most coiTect one. The agent with 
the oldest information changes its associated pointer to its ac- 
quaintance in the communication event, and updates the clock. 
By letting the agents memorize the acquaintances that pro- 
vided the newest information about other agents together with 
the age of this information, they will point in the direction of 
the fastest communication path from a target. Moreover, the 
fastest communication paths are ty pically close to the shortest 
paths iRosvall & Sneppeii 
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FIG. 4 Self-assembly of information in networks. The size and the 
color of the nodes reflect the age of the information the well con- 
nected agent in the middle has of other agents. The width of the 
links reflects the relative amount of information they transfer to this 
agent, and the color the average quality (age) of this information. The 
agents make use of the hubs to create short communication-paths. 

Figure 13 shows the perception arou nd the central node in a 
model network (see also Java applet fURC, c]). Clearly the 
information is most up to date in the immediate neighbor- 
hood of the agent, but that distant communication-pathways 
extend the whole network. In a more detailed investiga- 
tion, we found that messages are most e ffectively forwarded 
in the presence of hubs with funneling IJef frev & Milgrarnl 
like in scale-free networks, while transmission in hub- 



free networks is more robust against misinformation and fail- 
ures. This is in overall accordance with Stanley Milgram's 
famous experiment, where letters were transmitted by se- 
quences of acquaintance-acquaintance contacts across USA 
llJeffrev & Milgram. 1969. Milgram. 19671 . The choice of ac- 
quaintances was based on the participants' network percep- 
tion, including also geographic closeness of the acquaintance 
to the target (first steps) an d similarity of o ccupation (later 
steps) to forward messages llKillworth & Be rnard. 197^. Of 
course, these are two of many layers that could be added to the 
model. However, the minimalistic model demonstrates that 
simple local rules allow agents to build a perception of the 
system, which is enough to overcome the information horizon 
llFriedkinIll983ll set by immediate acquaintances. In this way 
the "small world" is really small fKochen", 1989, "Milgraml 
Il9671 . and it makes sense to talk about navigation or search 
in networks and to quantify the information associated to this 
process. 

Given the agents' perception of the network it is tempting to 
take this social game one step further, and in the next section 
we give the agents a social mobility. The agents can thereby 
get new acquaintances to meet different interests. 
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FIG. 5 Illustration of the feedback from communication on the 
topology of both the communication network and the perception net- 
work at four different levels of communication C. C = 1 corresponds 
to on average 1 communication event per link and rewiring event. 
The system size is A' = 1000 agents connected by L = 2500 links. 



IV. SELF-ORGANIZATION OF NETWORKS 

Social mobility may be seen as the response to the quest 
for better information access in a social system. We let agents 
communicate to build a perception of a network as in the pre- 
vious section, and further allow the agents to use this informa- 
tion to create strategic links. In this way we are able to inves- 
tigate the feedback between different communication habits 
and the topology, while the agents self-organize the social net- 
work. 

The core of the model is the same as in the previous sec- 
tion. To this we add the possibility to rewire the network, and 
the model can be formulated in the two independent events 
faosvall & Sneppen. 2006a I : 

• Communication: Select a random link and let the two 
agents that it connects communicate about a random 
third agent. The two agents also update their informa- 
tion about each other 

• Rewiring: Select a random agent and let it use the lo- 
cal information to ask an acquaintance about whom to 
establish a link to, to shorten its distance to a randomly 
chosen other agent (the answer is the agent that the ac- 
quaintance points to). Subsequently a random agent 
loses one of its links. 

The communication event is typically repeated of the order of 
number of links in the system for each rewiring event. 

We quantify the self-organization between communication, 
the network, and the per ception of this network, in Fig.|5l(see 
also Java applet f URLl y]). The perception network is de- 
fined by nodes as agents, and links between all pairs of nodes 
where at least one of the corresponding agents has a pointer 
to the other agent. Hence the perception network reflects the 



imperfect picture the agents have of their surrounding, as out- 
dated pointers cause diverging communication and perception 
networks. 

We started with random Erdos-Renyi networks 
[Erdos & Renvi, Il959ll (the results are independent of 
initial conditions) and let the system evolve at different com- 
munication levels C. The system size was A^ = 1000 agents 
and L = 2500 links. C • L is the number of communication 
events per rewiring event in the network, and the degree k of 
a node is its number of links. At low communication level, 
C < 1 , the perception network has many more links than the 
communication network, reflecting the failure of agents to 
perceive connections that are lost recently. As C approaches 
C ~ 1 the perception network prunes its links whereas the 
communication network develops nodes with high degrees 
(the distribution can be approximated by a power law 
P{k) o= k^^-^). At even higher values of C the two networks 
converge toward the same broad degree-distribution — local 
communication gives rise to global organization. 

The presented model describes a social game where the 
aim is to be central, and a winner is an agent with many 
connections that provide short and reliable communication to 
other agents. The fact that we observe agents with a wide 
range of degrees reflects the diversity of the possible out- 
comes of the game, and raises the questions about whether 
there are some particular strategies with which agents can im- 
prove their standing in the network? In a more detailed in- 
vestigation, we found that individual increase of communica- 
tion gives both a local gain for the agents that adopt the com- 
munication strategy, and a g lobal gain for the whole system 



mumcation strategy, ana a g i( 
llRosvall & Sneppenll2006all . 



V. SUMMARY 

We started by investigating how the network topology af- 
fects the communication ability in various networks, and 
demonstrated that many real-world networks favors commu- 
nication on short distance at the cost of constraining commu- 
nication on long distance. Thereafter we examined the abil- 
ity to self-organize locally available information in a system 
such that messages can be guided between distant parts of 
the network. Our approach was to let agents chat in a model 
system to self-organize distant communication-pathways. We 
demonstrated that simple local rules allow agents to build a 
perception of the system that is robust to dynamical changes 
and mistakes. 

Finally we explored the local dynamic origin of global net- 
work organization by modeling the response to information 
transfer in a simplified social system. We found that a low 
communication level results in chaotic or Erdos-Renyi like 
networks, whereas higher communication levels with more 
reliable communication-pathways lead to structured network 
topologies with broad degree-distributions. 

Overall we have used networks to quantify our limited in- 
formation horizon. In a society the information horizon is set 
by each individual's social contacts, which in turn is a part of 
the global network of human communication. By measuring 
the information necessary to locate specific nodes in a net- 
work we were able to quantify this horizon, and by introduc- 
ing a social game we investigated different ways to overcome 
the horizon. 

We acknowledge the support of The Danish Na- 
tional Research Foundation: "Models of Life" at 
NBI. 
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